Making superintelligent A.I. is a really hard challenge.

创造出个超级智慧体确实是个很的挑战。

Could you two really have some sort of superintelligent child?

你俩真的会出那种智商超群的宝宝吗?

So imagine we hit upon a design of superintelligent AI that has no safety concerns.

想象我们正好做出了个没有任何安全隐患的超级人工智能。

I bet there are those of you who doubt that superintelligent AI is possible, much less inevitable.

我打赌你们有些人还会怀疑超级人工智能是否可能实现，认为我是在小题做。

But, as a thought experiment, let's just say that superintelligent computers will emerge.

但是，作为种思想实验，假设超智能计算将会出现。

But such an intelligence explosion might  lead to a true superintelligent entity.

但这样的智能爆炸可能会导致真正超级智能实体的出现。

Let's give this superintelligent AI a simple goal.

让我们给这个超级智能AI设定个简单的目标。

If we have a superintelligent system, how will it make our life better?

如果我们拥有个超级智能系统，它将如何让我们的变得更美好？

We've created an AI so vastly powerful, so unfathomably intelligent, that we might call it superintelligent.

我们创造了种人工智能， 其力量之强，智慧之深邃， 以至于我们可能称之为超级智能。

In this episode, the fringe beliefs that are helping to fuel the drive towards superintelligent AI.

在这，那些边缘信念正在推动超级智能AI的发展。

It better be too early than too late when it comes to superintelligent AI systems.

在超级智能AI系统方面，宁可早些，也不要太迟。

Still others view AI with more suspicion – why would a superintelligent AI waste its time taking care of us?

还有些人则对人工智能持怀疑态度——为什么超级智能的人工智能会浪费时间来照顾我们？

Right? So imagine if we just built a superintelligent AI that was no smarter than your average team of researchers at Stanford or MIT.

那么，现在让我们来想象下我们刚建好个超级人工智能器，概和斯坦福或是麻省理工学院的研究员的平均水平差不多吧。

The point here is that we should not be confident in our ability to keep a superintelligent genie locked up in its bottle forever.

所以我们不能 对我们能够永远控制个超级智能体的能力 表示过度自信。

Maybe a single, superintelligent civilization has indeed taken over the galaxy and has imposed strict radio silence because it's paranoid of any potential competitors.

可能个非常有智能的文明已经占领了整个银河系，并且故意把辐射波屏蔽了，因为它们害怕潜在的竞争对手。

Eventually, it may modify and upgrade  itself, evolving into a superintelligent system that leaves humankind in the dust, perhaps more than just metaphorically.

最终， 它可能会自我修改和升级，进化成个让人类望尘莫及的超级智能系统，这或许不仅仅是比喻而已。

Predicting that exponentially improving technologies will take us to a point of a singularity, beyond which superintelligent artificial intelligence will transform our world in nearly unimaginable ways.

预测指数级改进的技术将把我们带到个技术奇点，超越这点后， 超级智能的人工智能将以几乎难以想象的方式改变我们的世界。

A superintelligent AI is by definition very good at attaining its goals, so the most important thing for us to do is to ensure that its goals are aligned with ours.

超级智能很善于完成它的目标，所以对我们来说，最重要的是确保它的目标和我们的致。

And perhaps most interestingly, the extropians' commitment to taking superintelligent AI seriously, it led them to talk a lot about the risks of the technology and how they could mitigate them.

而最有趣的是，熵减主义者对超级智能AI的严肃对待，使他们量讨论了这项技术的风险以及如何减轻这些风险。

Even if created solely with humanity's best interests in mind, superintelligent AI could pose an existential risk if it isn't perfectly aligned with human values— a task scientists are finding extremely difficult.

即使在创造时完全考虑到人类的最利益，如果超级智能 AI 不能完全符合人类价值观，它也可能会带来存风险——科学家们发现这是项极其困难的任务。